The process of replication target selection in psychology: what to consider?

Increased execution of replication studies contributes to the effort to restore credibility of empirical research. However, a second generation of problems arises: the number of potential replication targets is at a serious mismatch with available resources. Given limited resources, replication target selection should be well-justified, systematic and transparently communicated. At present the discussion on what to consider when selecting a replication target is limited to theoretical discussion, self-reported justifications and a few formalized suggestions. In this Registered Report, we proposed a study involving the scientific community to create a list of considerations for consultation when selecting a replication target in psychology. We employed a modified Delphi approach. First, we constructed a preliminary list of considerations. Second, we surveyed psychologists who previously selected a replication target with regards to their considerations. Third, we incorporated the results into the preliminary list of considerations and sent the updated list to a group of individuals knowledgeable about concerns regarding replication target selection. Over the course of several rounds, we established consensus regarding what to consider when selecting a replication target. The resulting checklist can be used for transparently communicating the rationale for selecting studies for replication.

Predictors of obsessive-compulsive symptomology: mind wandering about the past and future.

PURPOSE: Obsessive and compulsive tendencies are known to occur in the general population and involve worry around specific concerns (obsessions) and an urge to resolve the concern with thoughts or behaviours (compulsions). Spontaneous, but not deliberate, mind wandering experiences (when attention turns to internal mentation), have been found to predict obsessive- compulsive tendencies [Seli, P., Risko, E.F., Purdon, C. & Smilek, D. (2017). Intrusive thoughts: linking spontaneous mind wandering and OCD symptomatology. Psychological Research, 81, 392-398. https://doi.org/10.1007/s00426-016-0756-3 ]. Recent cognitive theory suggests a particular role for future-oriented spontaneous thought in obsessive-compulsive (OC) symptoms. Thus, we hypothesised that future-oriented rather than past-oriented spontaneous mind wandering would predict OC symptoms, such that more future-oriented mind wandering would be associated with increases in OC symptoms. METHODS: In an online survey design (nonclinical sample of 104 adults), participants completed three measures: Mind wandering: Spontaneous (MW-S) and Deliberate (MW-D) (Carriere, Seli & Smilek, 2013); Involuntary Autobiographical Memory Inventory (Berntsen, Rubin & Salgado, 2015); and Dimensional Obsessive-Compulsive Scale (DOCS) (Abramowitz et al., 2010). We adopted a linear regression approach to examine our hypotheses. RESULTS: We provided the first replication of the finding that OC symptoms are predicted by the frequency of spontaneous (but not deliberate) mind wandering, with an underlying positive relationship. Additionally, we found that temporality of spontaneous thought had different predictive effects as a function of the dimension of OC symptoms (i.e., responsibility, unacceptable thoughts, need for symmetry/completeness). CONCLUSIONS: We found moderate support for our temporality hypothesis, which highlights how the construct of temporality can add to our understanding of OC symptoms. The present study also adds to recent conceptual debates regarding mind wandering. We suggest new cognitive and methodological approaches to enhance the understanding of obsessive-compulsive disorder, opening new avenues for clinical and experimental research.

Synthesizing the effects of mental simulation on behavior change: Systematic review and multilevel meta-analysis.

Mental simulation of future scenarios is hypothesized to affect future behavior, but a large and inconsistent literature means it is unclear whether, and under what conditions, mental simulation can change people's behavior. A meta-analysis was conducted to synthesize the effects of mental simulation on behavior and examine under what conditions mental simulation works best. An inclusive systematic database search identified 123 (N = 5,685) effect sizes comparing mental simulation to a control group. After applying a multilevel random effects model, a statistically-reliable positive effect of Hedges' g = 0.49, 95% CI [0.37; 0.62] was found, which was significantly different than zero. Using a taxonomy to identify different subtypes of mental simulation (along two dimensions, class [process, performance, outcome] and purpose [whether an inferior, standard, superior version of that behavior is simulated]), it was found that superior simulations garnered more reliable beneficial effects than inferior simulations. These findings have implications for integrating theories of how mental simulations change behavior, how mental simulations are classified, and may help guide professionals seeking evidence-based and cost-effective methods of changing behavior.

Inducing involuntary and voluntary mental time travel using a laboratory paradigm.

Although involuntary past and future mental time travel (MTT) has been examined outside the laboratory in diary studies, MTT has primarily been studied in the context of laboratory studies using voluntary construction tasks. In this study, we adapted and extended a paradigm previously used to elicit involuntary and voluntary memories (Schlagman & Kvavilashvili in Memory & Cognition, 36, 920-932, 2008). Our aim was - for the first time - to examine involuntary and voluntary future MTT under controlled laboratory conditions. The involuntary task involved a monotonous task that included potential cues for involuntary MTT. Temporal direction was manipulated between participants whereas retrieval mode was manipulated within participants. We replicated robust past-future differences, such as the future positivity bias. Additionally, we replicated key voluntary-involuntary differences: Involuntary future representations had similar characteristics as involuntary memories in that they were elicited faster, were more specific, and garnered more emotional impact than their voluntary counterparts. We also found that the future and past involuntary MTT led to both positive and negative mood impact, and that the valence of the impact was associated with the emotional valence of the event. This study advances scientific understanding of involuntary future representations in healthy populations and validates a laboratory paradigm that can be flexibly and systematically utilized to explore different characteristics of voluntary and involuntary MTT, which has not been possible within naturalistic paradigms.

Amnesia and future thinking: Exploring the role of memory in the quantity and quality of episodic future thoughts.

OBJECTIVES: To examine the impact of memory accessibility on episodic future thinking. DESIGN: Single-case study of neurological patient HCM and an age-matched comparison group of neurologically Healthy Controls. METHODS: We administered a full battery of tests assessing general intelligence, memory, and executive functioning. To assess autobiographical memory, the Autobiographical Memory Interview (Kopelman, Wilson, & Baddeley, 1990. The Autobiographical Memory Interview. Bury St. Edmunds, UK: Thames Valley Test Company) was administered. The Past Episodic and Future Episodic sections of Dalla Barba's Confabulation Battery (Dalla Barba, 1993, Cogn. Neuropsychol., 1, 1) and a specifically tailored Mental Time Travel Questionnaire were administered to assess future thinking in HCM and age-matched controls. RESULTS: HCM presented with a deficit in forming new memories (anterograde amnesia) and recalling events from before the onset of neurological impairment (retrograde amnesia). HCM's autobiographical memory impairments are characterized by a paucity of memories from Recent Life. In comparison with controls, two features of his future thoughts are apparent: Reduced episodic future thinking and outdated content of his episodic future thoughts. CONCLUSIONS: This article suggests neuropsychologists should look beyond popular conceptualizations of the past-future relation in amnesia via focussing on reduced future thinking. Investigating both the quantity and quality of future thoughts produced by amnesic patients may lead to developments in understanding the complex nature of future thinking disorders resulting from memory impairments. PRACTITIONER POINTS: We highlight the clinical importance of examining the content of future thoughts in amnesic patients, rather than only its quantitative reduction. We propose an explanation of how quantitative and qualitative aspects of future thinking could be affected by amnesia. This could provide a useful approach to understand clinical cases of impaired prospection. LIMITATIONS: Systematic group investigations are required to fully examine our hypothesis. Although the current study utilized typical future thinking measures, these may be limited and we highlight the need to develop clinically relevant measures of prospection.

Do future thoughts reflect personal goals? Current concerns and mental time travel into the past and future.

Our overriding hypothesis was that future thinking would be linked with goals to a greater extent than memories; conceptualizing goals as current concerns (i.e., uncompleted personal goals). We also hypothesized that current-concern-related events would differ from non-current-concern-related events on a set of phenomenological characteristics. We report novel data from a study examining involuntary and voluntary mental time travel using an adapted laboratory paradigm. Specifically, after autobiographical memories or future thoughts were elicited (between participants) in an involuntary and voluntary retrieval mode (within participants), participants self-generated five current concerns and decided whether each event was relevant or not to their current concerns. Consistent with our hypothesis, compared with memories, a larger percentage of involuntary and voluntary future thoughts reflected current concerns. Furthermore, events related to current concerns differed from non-concern-related events on a range of cognitive, representational, and affective phenomenological measures. These effects were consistent across temporal direction. In general, our results agree with the proposition that involuntary and voluntary future thinking is important for goal-directed cognition and behaviour.

Implausible future events in a confabulating patient with an anterior communicating artery aneurysm.

Patient MW, a known confabulator, and healthy age-matched controls produced past and future events. Events were judged on emotional valence and plausibility characteristics. No differences in valence were found between MW and controls, although a positive emotional bias toward the future was observed. Strikingly, MW produced confabulations about future events that were significantly more implausible than those produced by healthy controls whereas MW and healthy controls produced past events comparable in plausibility. A neurocognitive explanation is offered based on differences between remembering and imagining. Possible implications of this single case in relation to confabulation and mental time travel are discussed.

Episodic future thinking: linking neuropsychological performance with episodic detail in young and old adults.

Episodic future thinking (EFT) has been linked with our ability to remember past events. However, its specific neurocognitive subprocesses have remained elusive. In Experiment 1, a study of healthy older adults was conducted to investigate the candidate subprocesses of EFT. Participants completed a standard EFT cue word task, two memory measures (Verbal Paired Associates I, Source Memory), and two measures of executive function (Trail Making Test, Tower Test). In Experiment 2, healthy young adults also completed an EFT task and neuropsychological measures. The link between neurocognitive measures and five characteristics of EFT was investigated. Specifically, it was found that Source Memory and Trail Making Test performance predicted the episodic specificity of future events in older but not younger adults. Replicating previous findings, older adults produced future events with greater semantic but fewer episodic details than did young adults. These results extend the data and emphasize the importance of the multiple subprocesses underlying EFT.

Mental time travel: effects of trial duration on episodic and semantic content.

Studies exploring mental time travel commonly use cue-word paradigms to elicit past and future autobiographical events. However, the effect of trial duration (how long participants are allowed to describe events) on the relationship between episodic and nonepisodic detail and episodic specificity (i.e., whether longer durations increase event specificity) has not been examined. To resolve these issues, a cue-word study was devised whereby participants described past and future events under three randomly administered time constraints: short (1-min), standard (3-min), and long (5-min) durations. Findings indicated that an individual's capacity for episodic and nonepisodic thought for the past and future were unrelated. This lends supports to the idea that independent mechanisms are responsible for episodic and semantic information. This study also offers clarity concerning the effect of different trial durations on episodic specificity, which may aid the design of future studies of mental time travel.